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METHODS AND ARTICLES FOR DETECTING, VERIFYING, AND REPAIRING 
COLLINEARITY IN A MODEL OR SUBSETS OF A MODEL 

RELATED APPLICATION 

This application claims the benefit of U.S. Provisional Application No. 
5 60/457,060, filed on March 21, 2003. The entire teachings of that application are 
incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

Model Predictive Control (herein referred to as "MPC") is a technology utilized 
in various Advanced Process Control (herein referred to as "APC") systems. MPC- 

10 based systems have been implemented on thousands of refining and chemical processes 
over the past two decades. DMCplus®, and the earlier version, DMC, (both available 
from Aspen Technology, Inc. of Cambridge, Massachusetts) is a widely used MPC- 
based system. In an MPC-based system, a model is used to predict the future behavior 
of a process, given the current and history input information (e.g., measurements of 

1 5 process conditions). An optimized control plan is calculated such that the predicted 

future response and the control action needed to achieve the response will satisfy certain 
predefined criteria. Once the calculated control plan is implemented (e.g., after the first 
point of the control move is implemented), the process measurements are collected and 
fed back to the controller to update the model predictions. A new control plan 

20 calculation is then initiated. 

In an MPC-based controller, the model plays a central role. The model not only 
dictates the accuracy of the predictions, but it also affects the control actions. Model 
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uncertainty is inevitable in practice, so the quality of the model should be evaluated 
based on its relevant application (i.e., not just the model's predictive ability, but also its 
control performance). 

Collinearity in the model impacts control performance significantly. Excessive 
5 control action is one problem associated with unsolved collinearity in a model. The 
action of the controller, at least to some extent, mirrors the response from the model 
universe. When the model is nearly collinear, but is not perfectly collinear, excess 
v control action may be generated in response to changes in system constraints or to 

achieve insignificant objective function improvements. A second problem associated 

10 with unsolved collinearity is that of unstable closed-loop control. If both the model and 
the underneath process are nearly collinear, but they have different directionality, the 
closed-loop system will become unstable. A third problem associated with unsolved 
collinearity is poor process performance. If the underlying process being modeled is 
not collinear, but the model is, then the controller will treat the process as if it has fewer 

1 5 degrees of freedom in the controlled variables and will not explore the full potential of 
the process. Poor control performance can even cause damage to the normal operation 
of the process. 

Numerous attempts have been made to alleviate the problems posed by 
collinearity to MPC implementations. For example, some tools developed by the APC 

20 community detect a collinear model, or model subsets, through the use of either 
Relative Gain Array (herein referred to as RGA) or Singular Value Decomposition 
(herein referred to as S VD) to detect a collinear model or model subsets. See, for 
example, J.M. Maciejowski's "Multivariable Feedback Design," published by Addison- 
Wesley Publishing Company, 1990, ISBN 0-201-18243-2, the entire teachings of 

25 which, are incorporated herein by reference. Some of those tools also adjust the model 
to minimize the RGA number; however, those approaches are limited to a 2x2 system. 

A need exists for methods and articles for systematically detecting, verifying, 
and repairing collinear models. 
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SUMMARY OF THE INVENTION 

This invention provides systematic methods to detect, verify, and repair the 
collinearity of a model or its subsets (also referred to as "sub-matrices"), such as models 
used for MPC-based control. 
5 In one embodiment of the invention, a method first uses S VD to search over a 

given model matrix and identify all nearly collinear model subsets based on give 
condition number thresholds. Then the method estimates the control action 
aggressiveness or magnitude should the model be used for MPC-based control. 

The method recommends a directional plant test to excite the process in its weak 

10 direction. After the directional plant test, a new model identification is conducted on 
the transformed space spanned by singular vectors. The transformed identification 
result is used to verify if the underneath process is truly collinear. If the verification 
concludes that the process, or a part of the process, is nearly collinear, then a 
"Collinerization" procedure is implemented. If the verification indicates that the 

1 5 process is not close to collinearity, then an "Uncollinearization" procedure is 
implemented. 

In Collinearization, the smallest singular values of each selected subset of the 
model are set to exactly zeros while keeping the directionality unchanged (i.e., same 
singular vectors). If more than one solution is available, the one which is closest to the 
20 original model is selected and the deviation is minimized. In Uncollinearization, the 
condition numbers of each selected subset of the model are maximized through the 
adjustment of the model while keeping the directionality unchanged. In either case, the 
model is adjusted subject to the given constraints (e.g., model uncertainty bounds or any 
linear equations). 

25 In some embodiments, this invention includes a systematic methodology to 

detect, verify, and repair collinearity or near collinearity in a model used for Model 
Predictive Control purposes. 

In further embodiments, this invention includes a method of detecting, verifying, 
and repairing collinearity or near collinearity in a model. In one example, the method 

30 comprising the steps of defining bounds for a gain matrix, specifying a collinear 
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threshold, examining the matrix to identify all near-collinear sub-matrices, scaling at 
least one weak output for each near-collinear sub-matrix, adjusting a control action 
magnitude, determining what type of model repair would be desirable, constructing a 
quadratic programming problem, and solving the quadratic programming problem to 
5 generate a new model matrix. 

In yet another embodiment, this invention includes the use of an optimization 
formula, to make a selected sub-model perfectly collinear while the same directionality 
is maintained and the model deviation is minimized. 

In still more embodiments, this invention includes the use of an optimization 
10 formula, to make a selected sub-model less collinear while the same directionality is 
maintained and the model deviation is minimized. 

In some embodiments, this invention includes a computer program product, 
comprising a computer usable medium, and a set of computer program instructions 
embodied on the computer useable medium for detecting, verifying, and repairing 
1 5 collinearity or near collinearity in a model used for Model Predictive Control purposes. 
In other embodiments, this invention includes a computer system to detect, 
verify, and repair collinearity or near collinearity in a model used for Model Predictive 
Control purposes. In one example, the computer system comprises a data transfer 
means for transferring data among components of a computer, a digital processor 
20 coupled to receive input from the data transfer means, and an output means coupled to 
the digital processor. The digital processor executes a method for analyzing a model 
used for Model Predictive Control purposes. The model detects collinearity or near 
collinearity in the model, verifies the collinearity or near collinearity in the model, and 
repairs the collinearity or near collinearity in the model. The output means provides to 
25 a user the analyzed model. 

In still more embodiments, this invention features a chemical species 
manufactured by a process that includes a modeling method, wherein the modeling 
method is analyzed to detect, verify, and repair collinearity or near collinearity. 

The methods of this invention can be applied simultaneously to more than one 
30 model subset, which is advantageous when dealing with multiple model subsets that 
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share common elements. There is no limitation on the size of the collinear models or 
collinear subsets (at least 2x2, 3x3, 4x4, 5x5, 6x6, or more than 6x6). Both 
collinearization and uncollinearization are posed as a Quadratic Programming (QP) 
problem, and hence have unique solutions and can be solved efficiently. Additionally, 
5 this invention allows the imposition of constraints model gain(s) while the changes in 
the gain(s) is minimized. For example, some constrains that can be imposed are high 
and/or low bounds, material and/or energy balances, and the like. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects, features and advantages of the invention will 
10 be apparent from the following more particular description of preferred embodiments of 
the invention, as illustrated in the accompanying drawings in which like reference 
characters refer to the same parts throughout the different views. The drawings are not 
necessarily to scale, emphasis instead being placed upon illustrating the principles of 
the invention. 

1 5 Figure 1 is a flow diagram of a process embodying the present invention 

method. 

Figure 2 illustrates a computer implementation of the present invention. 
Figure 3 is a block diagram of the internal structure of a computer in the 
computer system of Figure 2. 
20 Figure 4 is a graph illustrating linear dynamics of a simulated process. 

Figure 5 is a graph illustrating test data from a regular step test. 
Figure 6 is a graph illustrating test data from a directional test carried out as 
defined by a weak direction. 

Figure 7 illustrates a model for (mt,ct) identified using directional test data. 
25 Figure 8 illustrates a model with a gain of gR = 0. 1 553 1 . 

DETAILED DESCRIPTION OF THE INVENTION 

A description of preferred embodiments of the invention follows. While this 
invention has been particularly shown and described with references to preferred 
embodiments thereof, it will be understood by those skilled in the art that various 



1086.2017-001 



6- 



changes in form and details may be made therein without departing from the scope of 
the invention encompassed by the appended claims. 

In order to describe the methods and articles of this invention in detail, an 
exemplar system will first be defined. It will be apparent to those of skill in the art that 
these definitions are for illustrative purposes only and that this invention includes 
additional methods not illustrated herein. It will also be apparent to those of skill in the 
art that this invention is applicable to systems and models that are not illustrated and/or 
do not comport with the definitions listed herein. 
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Definitions 

Consider a model (G) which relates manipulated variables {MV) to controlled 
variables (CF), such that CV = G*MV or: 



Equation 1 



The model G can be, for example, the steady-state gain matrix or the frequency domain 
transfer functions. In the later case, the we consider the collinearity issue for a given 
frequency. 

Assume n > m and that the matrix G has the following singular values from 
SVD calculations: 

cri,o-2, ,Om where en >= 0*2 >= >= <j m >= 0 . 

The original gain matrix can then be represented by Equation 2: 

G = U* Diag(o>) * V Equation 2 

Here, and are both unitary matrices, and C/, and F, represent the i th column of 
U and V, respectively. From the property of SVD, we have the following relationships 
(collectively referred to herein as "Equation 3"): 



CT1 = max*,™ 



\\ cv ¥ A . \\ cv ¥ 

and a m = miIW*oi ~ 



\MVh 



WMVh 
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The maximum is achieved when MV moves along the direction defined by Vj (herein 
referred to as "the strong direction"), and the minimum is achieved when MV moves 
along the direction defined by V m (herein referred to as "the weak direction"). 
From Equation 2, each element in G can be expressed by Equation 4: 

m 

5 go ' = ^ ok * wk * vjk Equation 4 

*=i 

For a square system (i.e., where n = m), the relationship defined by Equation 2 can be 
reversed as shown in Equation 5: 

Diag(ot) = U'*G * V Equation 5 

Given the threshold s > 0, a model matrix has a rank of r(s) if: 
10 Grlo\ >= s and o> + i/cri <s . 

r(s) > 0 and r(s) < m. If r(s*) = w, then the given system has a full rank and the matrix is 
not "collinear." If r(s) < m and o m = 0, the system is "collinear" or "perfectly collinear." 
If r{s) < m and a m = 0, then the system is "nearly collinear." 

A transformed input vector MT and a transformed output vector CT as follows: 
15 MT = V X *MV Equation 6 

CT = U'*CV Equation 6.1 

Then the transformed input and output variables have the following relationship: 

cti = Oi * mti , / - 1,..., w Equation 7 

G(j/h) is a square sub-matrix derived from G, where sm = 1 . . , p and p is the number of 
20 all possible square sub-matrices. The dimension of G{sm) ranges from 2x2, 3x3, . . . , to 
mxm. When dealing with collinearity, the focus can be placed on square sub-matrices 
because if a nxm matrix is collinear (where n > w),then all its mxm sub-matrices must 
be collinear too. 

25 Collinearity Detection 

For a given model matrix G, and a given threshold s, a search over all sub- 
matrices G{sm), where sm = 1,. is conducted and the sub-matrices are sorted into 
three groups: 1) a not collinear group, G n (sm); 2) a nearly collinear group, G nc (sm)\ and, 
3) a collinear group, G c (sm). 
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If the G nc (sm) group is empty, the method can be stopped. Alternatively, the 
threshold value can be modified and the method of the invention begun again. If the 
G nc (sm) group is not empty, the collinearity of the sub-matrixes in that group is verified. 

5 Collinearity Verification 

When a sub-matrix falls into the nearly collinear group, the available degree of 
freedom is then either recognized or ignored even though the extra capability may be 
limited. In order to determine the best course of action for a given application, the 
collinearity can be verified. This verification includes determining whether the control 
10 action is acceptably aggressive for the needs of the given application, and controlling as 
described below: 



Control Action Magnitude 

When a system is nearly collinear, the associated control action for certain CV 
15 targets will be aggressive, since the control action is, to some extent, proportional to the 
response of the model inverse. The most significant magnitude (in the sense of 2-norm) 
of MV change happens when the CFmove along the weak direction, that is, 

CV =a*Um,a e R Equation 8 

MV = (a/am)* Vm Equation 9 

20 a can be used as a scaling number so that the CV change will be in a desired 

range, and then the required MV change can be estimated from Equation 9. Based on 
the knowledge of the process, a practitioner can make a judgment if the control action 
required to achieve the targets is reasonable. If it is determined that the control action is 
desirable, then the near collinearity is acceptable and no model adjustment is necessary. 
25 If it is determined that the action is not desirable, a directional test and identification is 
performed. 



30 



Directional Test and Identification 

As shown in Equation 7, for a nearly collinear process, the transformed outputs 
ctij = r + l,...,/w will have a relatively small response to the transformed inputs 



mtij = r + l,...,m . Moreover, their corresponding singular value a, is similar to the gain 
between the transformed input and the transformed output. This relationship provides 
an opportunity to verify if the real process is the case, by employing the following 
procedure: 

1 . Perturb the system in such a way that the input signals follow the 
direction specified by UiJ = r + l,...,/w . 

2. Construct transformed input and outputs vectors mU and 
ctij = r + using the collected test data. 

3. Identify model between mU and ctij = r + l,...,/w . 

4. If the identified gain in the transformed space is close to 07 and the 
uncertainty bound of the identified gain surrounds 0, then this portion of 
the process is deemed to be truly collinear; otherwise, it is deemed to be 
not collinear. 

5. The newly collected test data is used to improve the model quality by 
rerunning the identification because the newly collected data contains 
rich process responses in the weak direction. 

6. Repeat the collinearity detection with the improved model. 

7. The iteration of this procedure should be terminated based on the 
convergence situation and the desires of the practitioner. 

When conducting the directional test, all inputs are perturbed simultaneously 
with their direction and magnitude defined by the singular vector. As such, the inputs 
are highly correlated. Therefore, the identification is done either on the transformed 
space or the new data after it has been merged with the existing data. 

One benefit from doing the test and identification in the transformed space is 
that a less conservative uncertainty bound can be estimated. Normally, each model 
curve has its own uncertainty bound and is independent from each other or univariate. 
This kind of uncertainty bound can be overly conservative. With the identification in 
the transformed space (since the singular vectors are unitary, their role is very similar to 
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using latent variables), we are able to get an uncertainty described by a linear inequality 
(multivariate). This may result in a less conservative uncertainty description. 

The relationship between the transformed variable and the original variables is 

n m 

as follows. Assume ct = ^aj* cvj and mt = ^bi * mvt . A gain k is identified for 
5 {mt,ci). That is, 

n m 

* cvj = k * ^bi * mvi 

7=1 /=1 

In the original space, the inputs and outputs satisfy the following equation: 

m 

cvj = ^ gji * mvi 
/=! 

Combining the above two equations, we have 
10 J (^a7-g>/-A:*6/)*/wv/ = 0 

/=1 7=1 

Each mvj is independent, and: 

n 

= ** 6 ' 5 / = l,..:,/w 

or 

n 

C^ctj * gji) I bi = k , / = l v ..,w Equation 10 

7=1 

1 5 Knowing the uncertainty bound on k allows the translation of this bound into a 

constraint on the original gain matrix (a linear inequality) with the use of Equation 10. 
This additional constraint can contribute to a less conservative uncertainty description 
and can be incorporated into the Collinearization and Uncollinearization procedures, as 
discussed subsequent. 

20 

Collinearization 

If the process is deemed nearly collinear, then it can be desirable to make the 
corresponding model to be perfectly collinear. In another word, a practitioner can 
reduce the degree of freedom shown in the model matrix so that the controller will 
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behave safer or in a more desirable manner. To accomplish this, the smallest singular 
value can be zeroed out using one of two approaches. 

Direct approach 

5 Using Equation 4 can force o> + / = 0,/ = l,...m - r and then a new model K can be 

recalculated from 

r 

hj = ^ok*wk*Vjk 

Since the dropped singular values are relatively small, the new model K will be similar 
to the original model G. 

10 

Optimization based approach 

In some applications, the direct approach may not be appropriate. For example, 
if the original elements g v are very close to 0, the direct approach can results in an 
adjusted model ky having the opposite sign as the original model. In some applications, 
1 5 such a change in sign value can make it difficult to determine if the new model can be 
used safely. In another example, a collinear sub-matrix may share common elements 
with another collinear sub-matrix in matrices that are larger than 2x2, so that when one 
sub-matrix is adjusted, the adjustment adversely affects the other sub-matrix. 

Furthermore, if the sub-matrices are repaired one by one, it can result in a never 
20 ending loop with the repairs to one sub-matrix giving rise to a need for more repairs to 
the other sub-matrix. In addition, changes in the directionality of the model can 
adversely affect the controller more than the original collinearity. 

Also, it can be desirable to impose constraints on how the model can be 
adjusted. For instance, a gain should not flip its sign and it should stay within its 
25 uncertainty bound, etc. 

To address these concerns, the following optimization formula is created: 

n m 

Minimize^ £ (go - gym) 2 Equation 1 0 

subject to: 
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go~ =<gv >i = l 9 ... 9 n 9 j = l,...,/w Constraint 10.1 

m(sm) m(sm ) 

crij (sm) =< ^ ^ gfo{sm) * uu(sm) * vkj(sm) <= atj (sm) Constraint 1 0.2 

i J = \^.,m(sm),sm = l 9 ... 9 p 
G(0) represents the nominal model, G + and G* represent the allowed upper and lower 
bound of the model. Oij and <r,/ are allowed upper and lower bound for the singular 
values. m(sm) is the dimension of the sub-matrix sm, p is the total number of nearly 
collinear sub-matrices G nc (sm). 

Equation 10 is the objective function. The objective function minimizes 
deviation from the nominal model as long as the required perfect collinearlity can be 
achieved. Constraint 10.1 represents the allowed variation for each model element. 
Constraint 10.2 is contributed from each nearly collinear sub-matrix. All un(sm) and 
vu(sm) are the singular vectors calculated from the original sub-matrix G nc (sm) 9 and 
hence the same directionality is always maintained. 

In some embodiments, a,/ and o*/ are set to 

1) crij(srn) = <j^{sm) = 0 if i ' * j , which corresponds to the off-diagonal 
portion of the singular value matrix; 

2) (j~a(sm) = cTuism) = 0 if / > r{sm) , which corresponds to those small 
singular values to be zeroed out; 

r 3) cu (sm) = a;(0) * (1 - eps) and an (sm) = a?(0) * (1 + eps) if / <= r(sm) , 
where 0 < eps < 1 is a constant. Choosing a large value for eps allows 
large variations in the singular values. Since the objective function 
always tries to find the minimal variation for the model matrix, it is 
expected that variation of the singular value will also be very mild. 
Hence, a small eps (for instance, eps = 0.1) can be safely used. 
Finally, Equation 10 is a standard QP formula and can be solved globally and 
efficiently. 

Uncollinearization 
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If the process is not collinear, or is nearly collinear but needs the controller to fully 
explore its capability, then adjustments to the model can be made to improve the 
condition number so that an improved robustness can be achieved. 
Uncollinearization should satisfy the following requirements: 
5 1 . The repaired model should have the same directionality as the original model 

because changing the direction can cause unwanted control problems that can 
potentially result in a less desirable performance than with the original 
collinearity. 

2. The directionality change should be made within allowed ranges. Additional 
10 restrictions can also be imposed, such as additional linear equality or inequality 

constraints. 

3. When treating a model matrix larger than 2x2, a collinear sub-matrix can share 
common elements with another collinear sub-matrix. Such a case can result in a 
"zigzag game" or never ending loop, with repairs to one sub-matrix giving rise 

15 to a need for repairs to the other sub-matrix. Hence, the methodology should be 

able to deal with multiple sub-matrices in a synchronized way. 

To achieve these goals, the following optimization formula was created: 

p m(s m)-r (sm) 

Maximize (ar(sm) + / / ok *«) + *(0)) 2 Equation 1 1 

sm=\ i-\ 

20 subject to: 

m(sm ) 

gij + (sm) =< ^ok(sm) * Uik(sm) * vjk(sm) <= gij'(sm) , i 9 j = l 9 ... 9 m(ms) Constraint 11.1 
*=i 

aj(sm) =< cn(sm) <= at(sm) 9 i - l 9 ... 9 m(sm) Constraint 1 1.2 

m(q) m(l) 

2^ok(q) * m(q) * vjk(q) = £o*(0 * Wk(t) * vjk(t) , Constraint 1 1 .3 

k=\ k=\ 

for those ij which point to the same element in G 9 sm 9 q,t= 1 # # t. 
25 gy + and gy" denote the upper and lower bounds of the allowed model adjustment, 

o'i and o? are upper and lower bounds on the singular values, <jr + /(0) represents the 
original singular value, and m(sm) is the dimension of the sub-matrix sm, p is the total 
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number of nearly collinear sub-matrices G nc (sm). Additional explanation of Equation 
1 1 is provided below. 

The objective function is to maximize the portion of the smaller singular values 
of all nearly collinear sub-matrices. The weighting factor, 1 / crr(sm) + /(0) , means the 
5 smaller the original singular value, the more improvement the optimizer will attempt to 
obtain. Constraint 11.1 represents the allowed variation for each model element. All 
Uik(sm) and vjk(sm) (as well as m(q) ,vjk(q) ,wk(t), and v;*(f) ) are the singular vectors 
calculated from the original sub-matrix Gnc(sm) (or Gnc(q) , Gnc(t) ), and hence the same 
directionality is always maintained. Constraint 1 1 .2 is the allowed singular value 

10 variation range, which is discussed further below. 

Constraint 1 1.3 is needed if there are two sub-matrices who share the same 
element in the original model matrix. In this case, any adjustment made for one sub- 
matrix will automatically be coordinated with another associated sub-matrix, and hence 
remove the "zigzag problem." 

1 5 The final goal is to maximize the condition number. Equation 1 1 does not 

explicitly employ a condition number because directly optimizing a condition number 
will pose a computation problem so difficult as to be unrealistic. As such, an 
approximation is made by maximizing the portion of the smaller singular values, while 
keeping the other singular values from dropping too low. For this purpose, the bounds 

20 for each singular value should be set as follows: 

1 . For a? <,/ = l,...,r , the singular values are only allowed to decrease, but 
not below <j r + 1(0) . 

2. For a <J = r + 1,..., m , the singular values are only allowed to increase, 
but not above a>(0) . 

25 That is: 

a - = « + i(0),/ = l,...,r 
0-+ = ai(O),/ = l,...,r 
cr~ = o;(0),/ = r + l,...,/w 
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at = Or(0) 5 / = r + l,...,w 
Equation 1 1 is a standard QP formula, and hence, can be solved globally and 
efficiently. 

Figure 1 illustrates a flow diagram of Process 15, embodying a method of the 
present invention. A model gain matrix is imported at Step 1 . For example, the model 
gain matrix can be imported from a MPC-based system, such as a system running a 
computer based control software (e.g., one for use in the chemical, petrochemical, 
pharmaceutical, petroleum, electric power, food, consumer products, metals, or mineral 
industries). Examples of such software include DMCplus® (available from Aspen 
Technology, Inc. of Cambridge, Massachusetts) or RMPCT (available from Honeywell, 
Inc., of Morris Township, New Jersey). For example, in a DMCplus® application, this 
step can include loading a MDL file. Any feed-forward variables should be excluded. 

At Step 2, the upper and lower bounds for the gain matrix are defined. For 
example, this can be the previously discussed uncertainty bounds or the percentage of 
gain variation allowed. Then a collinear threshold is specified at Step 3. 

At Step 4, the matrix is examined to identify all near-collinear sub-matrices. In 
some embodiments, this is accomplished with the use of Equation 5. Before any SVD 
calculation is carried out, a sub-matrix can be scaled so that the scaled sub-matrix has a 
condition number close to its optimal value. 

Step 5 includes presenting the following results to the user: 
all near-collinear sub-matrices, 
their singular values, 
weak inputs and outputs, and 
control action magnitude. 

Step 6 includes providing a scaling factor for each near-collinear sub-matrix so 
that the user can scale the weak outputs to a more meaningful or desired range. The 
control action magnitude is then automatically adjusted accordingly. In some 
embodiments, this is accomplished with the use of Equation 8. 
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At Step 7, the practitioner specifies what kind of model repair should be taken 
(e.g., Collinearization or Uncollinearizaton), and then selects which sub-matrix will 
participate in the repairs. 

Then at Step 8, the optimization program constructs a QP problem based on the 
5 inputs (e.g., submatrices that are to be repaired) and runs a QP solver to produce a new 
model gain matrix. In some embodiments, this is accomplished with the use of 
Equations 10 and/or 11. 

At Step 9, the results are evaluated and if the results are not satisfactory, Process 
15 is repeated, starting at Step 4, with the newly generated model matrix. This loop is 

10 repeated until satisfactory results are obtained. 

With satisfactory results, the threshold or uncertainty bounds are modified at 
Step 10, and the method is started again. Once the nearly collinear submatrices are 
repaired to the extent desired, then a practitioner proceeds to Step 11, which includes 
exporting the new model matrix. 

1 5 The present invention also includes computer implementation of methods to 

detect, verify, and repair the collinearity of a model or its subsets, such as models used 
for MPC-based control. Figure 2 illustrates one embodiment of such a computer 
implementation. Client computer(s) 50 and server computer(s) 60 provide processing, 
storage, and input/output devices executing application programs and the like. Client 

20 computer(s) 50 can also be linked through communications network 70 to other 

computing devices, including other client computer(s) 50 and server computer(s) 60. 
Communications network 70 can be part of the Internet, a worldwide collection of 
computers, networks, and gateways that currently use the TCP/IP suite of protocols to 
communicate with one another. The Internet provides a backbone of high-speed data 

25 communication lines between major nodes or host computers, consisting of thousands 
of commercial, government, educational, and other computer networks, that route data 
and messages. In another embodiment of the present invention, the methods are 
implemented on a stand-alone computer. 

Figure 3 is a diagram of the internal structure of a computer (e.g., client 

30 computer(s) 50 or server computers 60) in the computer system of Figure 2. Each 



1086.2017-001 



17 



computer contains system bus 80, where a bus is a set of hardware lines used for data 
transfer among the components of a computer. Bus 80 is essentially a shared conduit 
that connects different elements of a computer system (e.g., processor, disk storage, 
memory, input/output ports, network ports, etc.) that enables the transfer of information 
5 between the elements. Attached to system bus 80 is I/O device interface 82 for 

connecting various input and output devices (e.g., displays, printers, speakers, etc.) to 
the computer. Network interface 86 allows the computer to connect to various other 
devices attached to a network (e.g., network 70 of Figure 2). Memory 90 provides 
volatile storage for computer software instructions used to implement an embodiment of 
1 0 the present invention (e.g., Program Routines 92 and Data 94, such as Process 1 5, 
DMCplus®, and corresponding MDL files). Disk storage 95 provides non-volatile 
storage for computer software instructions and data used to implement an embodiment 
of the present invention. Central processor unit 84 is also attached to system bus 80 and 
provides for the execution of computer instructions. 

15 

Examples 

Some examples are provided here to illustrate the methodology described above. 
The examples are not to be interpreted as limiting in any way. 

20 Example 1 : Verifying Collinearity Using the Directional Test and Identification. 
Consider a 2x2 distillation process with the following configuration: 
mv\ = Reflux Flow with typical operating range [7,9] 
mv2 = Reboiler Steam with typical operating range [5,7] 
cvi = Top Impurity with typical operating range [6,9] 
25 cv2 = Bottoms Impurity with typical operating range [3,13] 

The process is simulated by linear dynamics shown in Figure 4, which has the 
following gain matrix: 

[-1.0005 1.0599 " 
°~ 1.0183 -1.1694 
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In the simulated process, certain colored noise is added to the output signals. 
First, a regular step test is carried out and the test data is shown in Figure 5. A process 
model is then identified using DMCplus® Model 5.0 and the model has the following 
gain matrix: 

"- 1.0057 1.0710 " 
1.0078 -1.1564 

A collinearity check on the identified gain matrix is run, and the SVD 
calculation shows the following result: 

"2.1236 0 1 
0 0.0394 



Grt = 



a = 



U = 



V = 



-0.6917 
_ 0.7222 

0.6703 
-0.7421 



0.7222] 
0.691 7 J 

-0.7421] 
-0.6703 



Based on the weak direction (using Equations 8 and 9 with a = -1 ), to achieve a delta 
change in 



would need a control action of 



Acvi 




'- 0.7222" 


ACV2 




-0.6917 


A/wvi 




"18.8349" 


Amvi 




17.0125 



This control action may be too aggressive from the engineering point of view and hence 
the process may have collinearity issues. To verify if the real process is the case, a 
directional test is carried out defined by the weak direction. That is, 

Amvi/Amvi = (-0.7421) /(-0.6703) = 1.1071 
The test data is shown in Figure 6. 

The transformed input and output are: 

mt = -0.7421 * wvi - 0.6703 * mvi 
ct = 0.7222 * cvi + 0.6917 * cvi 
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A model for (mt,ct) is identified using the directional test data and is shown in 
Figure 7. This model has a gain of go = 0.04665 , which is close to the smallest 
singular value 0.0394. A SVD calculation on the true process model G indicates the 
smallest singular value for the process is 0.0426. This suggests that the estimated value 
from the directional test is very close to the true one. To this point, it is concluded that 
the analysis of collinearity based on the identified model Grt is valid. 

To illustrate the importance of directional testing to a nearly collinear process, 
an identification is run in the same transformed space, but with the regular test data (i.e., 
without the directional test). Figure 8 illustrates the model, and it has a gain of g R = 
0. 1 553 1 . This value differs greatly from the true one. 

An improved model can be identified if both data sets (obtained from the regular 
test and the directional test) are utilized. The new model has a gain matrix of 

"- 1.0049 1.0661 " 
_ 1.0029 -1.1675 

Example 2: Collinearization or Uncollinearization Modification of a Gain Matrix To 
Maximize or Minimize the Condition Number 

Let's consider a gain matrix shown below: 

- 0.6112 - 0.8705 - 0.8161 - 2.2515 0 0 0 0 0 0 4.4013 0 
-2.8114 -5.3374 -10.1706 -30.0073 1.8984 1.8283 0.1132 0.0153 0.1204 0.0495 0 0 
-2.0609 6.0295 9.4035 24.5094 -1.6758 -1.7359 -0.154 -0.0253 -0.1818 -0.0677 0 0 
-0.6244 -1.4399 -2.5429 -7.4598 0.4203 0.4147 0 0.0091 0.0456 0.0187 0 -0.2577 
0.1446 0.3026 0.5424 1.5888 -0.0855 -0.0843 0 -0.0016 -0.0105 -0.004 0 0.1572 
-1.7149 -2.731 6.9034 17.5966 -1.2014 -1.2893 0 -0.0407 -0.1277 -0.0382 0 0 

- 0.0015 - 0.0034 0.004 0.0227 0 - 0.0016 0 0 0 0 0 0 



Got = 



G = 



20 Gi = 



Gi = 



Given a threshold of s = 0.0001, the following three sub-matrices are identified 
to be collinear: 

6.0295 -1.7359" 



-1.4399 0.4147 

"-1.6758 -0.1818' 
-0.4203 0.0456 



, with singular values a = (0.831627 7.578 18e - 5) 
, with singular values a - (3.443 1 1 6.69 126e - 5) 
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G3 = 



, with singular 



-2.8114 1.8984 1.8283 0.0153" 

-2.0609 -1.6758 -1.7359 -0.0253 

-0.6244 0.4203 0.4147 0.0091 

-1.7149 -1.2014 -1.2893 -0.0407_ 

valuesa = (3.2117 1.89876 0.60946 3.5965e-5) 

Assuming that each gain element is allowed to vary no more than 10% from its 
nominal value. 

The Collinearization results: 
6.0302 -1.73614" 



G2 = 



-1.44011 0.414617 



, with singular values a = (0.83 1 509 0) 



-1.67583 -0.181804 
-0.420308 0.0455975 



, with singular values a = (3.44302 0) 



G3 = 



-2.81033 1.89821 1.82815 0.0153128' 

-2.0605 -1.67583 -1.73614 -0.0254196 

-0.62416 0.420308 0.414617 0.00902449 

-1.71455 -1.20166 -1.28927 -0.0405464 



, with singular 



values<r = (3.21072 1.89861 0.602891 0) 
The uncollinearization result: 



Gi = 



5.56824 -1.59648 
-1.32195 0.408456 

" -1.5367 -0.1818 
-0.414725 0.0456 



with singular values a = (0.905079 0.0169216) 



, with singular valuescr = (3.64152 0.0666536) 



G3 = 



-3.09168 1.8772 1.79803 0.01377 

-2.11308 -1.5367 -1.59648 -0.02277 

-0.68684 0.414725 0.408456 0.00819 

-1.76702 -1.09372 -1.18305 -0.0400757 



, with singular 



values<r = (3.23766 1.9333 0.648371 0.00239357). 



